Section: New Software and Platforms

4D-SFE

4D-SFE: 4D Scene Flow Estimator from Light Fields

Keywords: Light fields - Scene Flow - Motion analysis - Depth estimation

Functional Description: This software implements a method for scene flow estimation from light fields by computing an optical flow, a disparity map and a disparity variation map for the whole light field. It takes as inputs two consecutive frames from a light field video, as well as optical flow and disparity maps estimated for each view of the light field (e.g. with a deep model like PWC-Net) and saved as .flo files. First the light field is divided into 4D clusters called superrays, then a neighboring weighted graph is built between the different clusters and finally a 4D affine model is fitted for every cluster, using the initial estimations from the optical flow and disparity estimations that are contained in the cluster and in the neighboring clusters.

• Participants: Pierre David and Christine Guillemot

• Contact: Christine Guillemot